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Abstract 

This paper develops an analytical and rigorous formulation of the 
maximum entropy generation principle. The result is suggested as the 
Fourth Law of Thermodynamics. 
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1 Introduction 

Engineering and technical thermodynamics is the science which studies both 
energy and the best use of available energy resources: energy and energy 
transformations, including power production, refrigeration, and relationships 
among the properties of matter. 

Energy is a thermodynamic property of systems, and that during an 
interaction, it can change from one form to another but the total amount 
of energy remains constant. The second law of thermodynamics states that 
energy has quality as well as quantity, and actual processes occur in the 
direction of decreasing quality of energy. Thermodynamics plays a key role 
in the analysis of systems and devices in which energy transfer and energy 
transformation take place. I. Dincer and Y.A. Cengel emphasize that Nature 
allows the conversion of work completely into heat, but heat is taxed when 
converted into work and, also, a careful study of this topic [energy] is required 
to improve the design and performance of energy-transfer systems. (Lucia 
2010). 

Stuart Kauffman has observed that since all free living systems are non- 
equilibrium systems indeed, since the biosphere itself is a non-equilibrium 
system driven by the flux of solar radiation it would be of the deepest im- 
portance, were it possible, to establish general laws predicting the behavior 
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of all non-equilibrium systems. Unfortunately, efforts to find such laws have 
not yet met with success. Kauffman notes that the systems whose behavior 
he wishes to predict are exceedingly complex. Microscopic models of such 
systems are so complex as to defy analysis (Morel and Fleck 2006). 

It has been proved that entropy is the quantity which allows us to describe 
the progress of non-equilibrium dissipative process. By using the maximum 
entropy production principle, MEPP or MaxEP, it has been proved that a 
non-equilibrium system develops following the thermodynamic path which 
maximises its entropy generation under present constraints (Lucia 1995, Lu- 
cia 2008). Considering the statistical interpretation of entropy, entropy not 
only tends to increase, but it will increase to a maximum value. Conse- 
quently, MEPP may be viewed as the natural generalisation of the Clausius- 
Boltzmann-Gibbs formulation of the second law. Moreover, from 1995 to 
2009 the principle of maximum entropy generation, elsewhere called maxi- 
mum entropy variation due to irreversibility or maximum irreversible entropy 
S g , has been proved for the open systems, and in 2008 it has introduced, for 
a general open system, also its statistical expression (Lucia 2008). 

The principle of maximum for the variation of the entropy due to irre- 
versibility represents a general principle of investigation for the stability of 
the open systems: this principle represents an important result in irreversible 
thermodynamics because it is a global theoretical principle for the analysis 
of the stability of open systems. 

Moreover, it allows us to link the global approach to the statistical one 
when irreversible phenomena occur. The problem of irreversibility is difficult 
and part of the difficulty is due to dealing with the statistical mechanics 
of a large number of particles, but a global approach has been proved in 
2008 (Lucia 2008). By entropy generation it has been introduced the global 
thermodynamic effect of the action of the forces finding a global expression 
which links the microscopical values to the macroscopical thermodynamic 
quantities (Lucia 2010). 

The principle of maximum entropy generation represents the macroscopic 
effect of these theories, which, conversely, are its statistical interpretation. As 
a consequence of this principle it has been proved the irreversible ergodicity 
(Lucia 2008). As H. Primas has pointed out (Primas 1999): 'The impor- 
tance of the ergodic theorem lies in the fact that in most applications we 
see only a single individual trajectory that is a particular realization of the 
thermostatic process. The Kolmogorov's theory of stochastic processes refers 
to equivalence classes of functions and the Birkoff 's ergodic theorem provides 
a crucial link between the ensamble description and the individual descrip- 
tion of chaotic phenomena.'. The modern concept of subjective probabilities 
implies a behaviour based on the Boolean logic (Primas 1999). The result 
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obtained represents also the relation between the probability measurement in 
the probability space and real statistical facts. Following H. Primas (Primas 
1999) the set-theoretical representation of the Boolean algebra in terms of 
a Kolmogorov probability space is useful because it allows to relate a dy- 
namic in terms of a probabilistic density and all known context-independent 
physical laws are formulated in terms of pure states (Primas 1999). 

Moreover, it has been argued that the information of a complex sys- 
tem may be incomplete because the dynamics of the system can be only 
partially known consequently to its not complete accessibility (Wang 2004). 
In addition the PA-measure in the probability space is not yet univocally 
defined, and it is difficulty to develop a statistical thermodynamics for an 
irreversible system. In 2009 the integral expression of the PA-measure in the 
probability space, useful in statistical thermodynamics of the complex and 
irreversible systems, has been obtained (Lucia 2009). To do it the basis of the 
incomplete information on complex system was developed, underlying that 
in non-equilibrium transformation the volume of the phase space contracts; 
consequently, entropy generation were related to the incomplete information 
theory by using the Wang development of the Tsallis theory. This result 
underlines that the relevant physical quantities for the stochastic analysis 
of the irreversibility are the probability of the state in the phase space, the 
Hamiltonian valued at the end points of trajectory, and time (Lucia 2009). 

But, the Hamiltonian valued at the end points of trajectory in the phase 
space is not easy to be evaluated. In recent years, the study of an increasing 
numbers of natural phenomena that appear to deviate from standard statis- 
tical distributions has kindled interest in alternative formulation of statistical 
mechanics (Kaniadakis 2005). The new formulations of statistical mechan- 
ics should preserve most of the mathematical and epistemological structure 
of the Boltzmann-Gibbs theory, while reproducing the phenomenology of 
the anomalous systems (Kaniadakis 2005). This /t-theory obtained a lot of 
results in the analysis of natural phenomena, but it was not extended to 
irreversible open systems. A modified ^-theory has been proposed to use 
it in irreversible open systems, in order to obtain the integral value of the 
Hamiltonian at the end points of trajectory in the phase space, obtaining a 
new statistical expressions for the entropy generation (Lucia 2010). 

Here a summary of the maximum entropy generation principle is devel- 
oped in a formal way: can this theory represent a Fourth Law of Thermo- 
dynamics as a general principle applicable to non-equilibrium, irreversible, 
open, complex and dynamical systems? 
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2 The open system 

Definition 1 (Lucia 2008) - A system with perfect accessibility Qpa is a pair 
(Q,H), with Q := {<7j G M. 6N : Oi = (Pi,<li),i G [l,iV]}, being N the number 
of particles, qj G M. 6N , i G [1,-/V] £/ieir canonical coordinates and pi G M 6iV , 
« G [l,iV] i/ieir conjugate momenta, and II a sei whose elements tt are called 
process generators, together with two functions: 

TT^S (1) 

(ttV) ^tt'V (2) 

where S is the state transformation induced by tt, whose domain V (tt) and 
range TZ(tt) are non-empty subset ofQ. This assignment of transformation 
to process generators is required to satisfy the following conditions of acces- 
sibility: 

1. IIo - := {Sa : tt G II, a G V (tt)} = Q , Wa G f2: the set Ua is called the 
set of the states accessible from a and, consequently, it is the entire 
state space, the phase spase Vt; 

2. ifV(ir") n^(vr') ^ V(tt"tt') = S" 1 (V (tt")) and S^a = 
S^S^a^a G P(7r'V) 

Definition 2 (Lucia 2001) - A process in Qpa is a pair (tt, a), with o a state 
and tt a process generator such that a is in V (tt). The set of all processes of 
VLpa is denoted by: 

noil = {(tt,ct) : 7i G U,a G V (tt)} (3) 

// (tt, a) is a process, then a is called the initial state for (tt, a) and Sa is 
called the final state for (tt, a). 

Definition 3 (Lucia 2001) - A thermodynamic system is a system with per- 
fect accessibility Qpa with two actions W (tt, a) G R and H (tt, er) G K, called 
work done and heat gained by the system during the process (it, a), respec- 
tively. 

Hypothesis 1 (Lucia 2008) - There exists a statistics jipA describing the 
asymptotic behaviour of almost all initial data in perfect accessibility phase 
space flpA such that, except for a volume zero set of initial data a, it will be: 

1 T - 1 r 
irE^^^ / ^PA(dcr)(fi(a) (4) 

for all continuous functions ip on Qpa and for every transformation a h-> 

Stir). 
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Definition 4 - The triple (Qpa, J 7 , Ppa) , with T an algebra or a a— algebra, 
is a measure space, the Kolmogorov probability space Y . 

Definition 5 - A dynamical law t is a group of meausure-preserving auto- 
morphisms S : Qpa -> Qpa of the probability space T. 

Definition 6 (Lucia 2008) - A dynamical system Td = (Qpa, J 7 , Ppa, t) con- 
sists of a dynamical law r on the probability space T. 



3 Entropy generation 

In thermodynamics, the energy lost for irreversible processes is evaluated by 
the first and second law of thermodynamics for the open systems. So the 
following definition can be introduced: 

Definition 7 (Lucia 2009) - The entropy generation S g is defined as: 
W lost Q r T a \ AH AO , AE k + AE g - W 



= S g :=^(l-^\+^-AS+ — K '-- g (5) 

1 ref -L a \ r / ^ a ^ a 

where W\ os t is the work lost for irreversibility, T re f the temperature of the 
lower reservoir, Q r is the heat source, T r its temperature, T a is the ambient 
temperature, H is the enthalpy, S is the entropy, E k is the kinetic energy, 
E g is the gravitational one and W is the work. 

Following Truesdell (Truesdell 1970), for each continuum thermodynamic 
system (isolated or closed or open), in which it is possible to identify a ther- 
modynamics subsystem with elementary mass dm and elementary volume 
dV = dm/ p, with p mass density (Truesdell 1970, Lucia 1995, Lucia 2001, 
Lucia 2008) the thermodynamic description can be developed by referring to 

the generalized coordinates < t \ , with £j the exten- 

L > ie[i,JV] 

sive thermodynamic quantities and oif* their values at the stable states. 

Theorem 1 (Lucia 1995) - The termodynamic Lagrangian can be obtained 
as: 

C = -T ref S g (6) 

Theorem 2 - The principle of maximum entropy generation (Lu- 
cia 1995, Lucia 2008): The condition of stability for the open system' sta- 
tionary states is that its entropy generation S g reaches its maximum: 
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4 Irreversible ergodicity 



A real- valued random variable ix : VLpa — > K- on T induces a probability 
measurement /Ipa '■ J 7 —> [0,1] on the state space (J^, M). Considering the 
probability as a property of the generating conditions of a sequence, random- 
ness can be related to predictability and retrodictability (Primas 1999). A 
family {£ (t) : t € 71} is called a stocastic process, which can be represented 
by a family {7 (a (t)) : t e IR} of equivalent classes of random variables £ (t) 
on T. The point function 7(o"(£)) is called trajectory of the stocastic pro- 
cess £ (t). The description of physical systems in terms of a trajectory of 
a stochastic process corresponds to a point dynamics, while its description 
in terms of equivalent classes of trajectories and an associated probability 
measure corresponds to an ensemble dynamics (Primas 1999). 

Definition 8-^4 stochastic process is said weakly stationary if: 

3- [i (t a + t) i (tp + r)\ ev = [£ (t a ) £ {t p )] ev , Vt Q , t p , reR. 

Following Wiener and Akutowics, we can assume the following: 

Hypothesis 2 (Primas 1999) Every stationary process with absolutely con- 
tinuous spectral function (= regular process) is ergodic. 

The mathematical foundation of ergodic theory is to establish a connec- 
tion between phase average and time average (van Lith 2001). It follows an 
association between ergodic theory and objective interpretation of probabil- 
ity because the ergodic theory establishes a connection between probability 
measures and objective features of real word (van Lith 2001). A probabil- 
ity distribution is stationary if it is constant at all fixed points in T, and 
it reflects the fact that the system is in a steady state. Modern ergodicity 
is founded on the concept of measure preserving dynamical systems and 
on the Birkhoff's ergodic theorem (van Lith 2001). Here, considering the 
previous Section, we introduce the stochastic processes. To do so, we state 
that: 

Theorem 3 - If /ipa(^pa) is finite, then for any integrable function tp : 
VLpa — > R, the time average (ip) t on 7 is defined for all orbits 7 outside 
of a set Mtp of measure /i (A/^) = 0. Furthermore (<p) t is integrable, with 
(ip) t 07= (ip) t wherever it is defined, and with 

I ((p) t dVLp A = / ipdVtpA (7) 
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Corollary 1 - Birkoff's ergodic theorem. A measure preserving trans- 
formation S : VtpA is ergodic if and only if, for every integrable 
function ip : Qpa — > K ; the time average (ip) t on 7 is equal to the space aver- 
age f UpA f (cr) hp a (da) for all points cr outside of some subset M v of measure 
a (J%) = 0. 

Consequently, measurements results as the infinite time averages of phase 
functions because they take a long time compared to the microscopic relax- 
ation time and, for metrically transitive (= ergodic) systems, measurement 
results are almost always equal to microcanonical averages (van Lith 2001). 
Moreover, the initial states lead to different paths in phase space, so the 
averages depend on the initial state. 

Definition 9 - e-steady state. LetTd be a dynamical system and e = {es} 
be fixed and non zero. An open system is in e— steady state during the time 
interval T if and only if for all S G flpA there exists G R such that for all 
t G T it follows: 

\{S) T -(s\<e s (8) 

Consequently, the probability may fluctuate within small bounds and, 
consequently, dynamical evolution towards steady states is allowed. Every 
statistical observable is induced by a random variable, while an observable, 
that is a a-homomorphism, defines only an equivalence class of random vari- 
ables which induce this homomorphism. For a statistical description it is not 
necessary to know the point function a 1— > S (a), but it is sufficient to know 
the observable £. The description of a physical system in terms of an indi- 
vidual function n : a 1— > S (cr) distinguish between different points o G Qpa 
and corresponds to an individual description of equivalence classes of random 
variables does not distinguishes between different points and corresponds to 
a statistical ensemble description. 

Definition 10 - Let it be n : Qpa K o real-valued Borel function such 
that o 1 — y S (cr) is integrable over Qpa with respect to fipA, the expectation 
value ir ev of S (a) with respect to hpa is: 

7r ev := / S (cr) ^ip a (da) (9) 
Jn 

As a consequence of the theorem ([2]) and the relation (TT21) . it follows that: 

Theorem 4 - Irreversible ergodicity (Lucia 2008) - In non equilibrium 
transformation the volume of the phase space flpA contracts indefinitely. 
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5 Entropy generation and its statistics 



If the system is ergodic, the time-averages over infinite times coincide with 
the Gibbs phase-averages, but there remains open the problem that noth- 
ing is known concerning the time-averages for large but finite times. It was 
shown that the use of time-averages amounts to introducing a measure in 
phase space, suitably defined by the dynamics of the system. One can imag- 
ine that, if one has to deal with a metastable state ergodic behaviour is 
granted only on a times-scale much larger than the available one, then the 
orbits could exhibit some strange features, such as a non integer fractal di- 
mension on the observed time-scale, which may prevent the use of the Gibbs 
measure. It has been suggested that in some problems where metastable 
states show up, one has to replace the Gibbs measure by the Tsallis one. 
In the present paper we show that, if a system has dynamical time- averages 
compatible with a Tsallis ensemble, then, on a certain time-scale, the orbits 
have a definite non integer fractal dimension. We also show that the diffusion 
process of the orbits in phase space is, in some sense, slower than in the full 
chaotic case corresponding to Gibbs measure. In order to establish a cor- 
respondence between dynamics and Tsallis distribution one has to solve an 
analytical problem by an exact correspondence between dynamics and Tsallis 
distribution, given only for continuous-time dynamical systems and not for 
mappings. In the case of a mapping, such a correspondence is obtained by 
introducing a suitable limiting procedure (Carati 2008). 

In 1988 Tsallis postulated the physical relevance of one-parameter gener- 
alization of the entropy (Tsallis 1988), introducing a generalization of stan- 
dard thermodynamics and of Boltzmann-Gibbs statistical mechanics. In 
2002, Kaniadakis proved some properties for the generalized logarithm, so 
that we can introduce the following: 

Definition 11 (Kaniadakis 2003, Pistone 2009) The generalized exponential 
exp| K | is defined as follows: 

Definition 12 (Kaniadakis 2003, Pistone 2009) The generalized logarithm 
ln{ K } is defined as follows: 

lnw(r) = — ^— (11) 



2^2 



(/.', + \/l + li-T 

exp(r) 



1/k 



ifK^O 

ifn = 



(10) 
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Definition 13 (Lucia 2010) The statistical expression, for the irreversible- 
entropy variation, results: 



Sg = -$^P7 ln w(P7) ( 12 ) 

7 

with 

Pl = a exp {k} ^ - E \ T ^ (13) 

p 1 is the probability of the path 7, and a = [ exp ( — 

|J y Hj{0) k ^ r{T) dV + ^-)] 1 , H = u — YlifaPi non- equilibrium gen- 
eralisation of the grand- canonical Hamiltonian, # 7 (o) ««d ^7(1-) ^ e values of 
H at the end points of trajectory 7 in r = and r ; and 07 the time- averaged 
rate entropy production 0/7, and A = 2/c# are two arbitrary, real and positive 
parameters, \i = f$\j f$i , with j3i and (3 2 Lagrange multipliers in the entropic 
functional 

T=S K -fa^£ i i h -lJ -h^p^Kt-uj (14) 

which must be stationary for variations of f3\ and $1, and where E 1 is the 
energy of the j-th path and U is the total energy, ha^ K y(x) is an arbitrary 
function, a generalization of the logarithm function, whose properties have 
been studied by Csiszar (Csiszar 1967) and when \ns K \(x) = ln(x) the gener- 
alized entropy reduces to the Boltzmann-Gibbs- Shannon entropy (Wada and 
Scarfone 2009). 



6 Conclusions 

Ergodicity is the mechanism that allows us to pass from a mechanical de- 
scription of the system to a statistical one. A fundamental question is what 
happens if the system is not ergodic. If the system is not ergodic, we can 
still have a relatively simple statistical description of it if the trajectory is a 
fractal curve embedded in the smooth energy surface of Vt cells. If the re- 
duced box-counting dimension of such a curve is < d < 1 then the available 
phase space is a fractal object embedded in the Boltzmann 6N— dimensional 
smooth phase space: when d = 1 we regain completely the ergodicity (Garcfa- 
Morales and Pellicer 2006). 

The unifying principle of the maximum entropy generation allows to build 
a generalized thermodynamic formalism analogously to that of Hamiltonian 
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mechanics. This is clearly seen in the definition of the entropy and (fT2"j) . 
Many experiments in various fields of nuclear and condensed matter physics 
suggest the inadequacy of the Boltzmann-Gibbs statistics and the need for 
the introduction of new statistics (Kaniadakis and Lissia 2003). In particular 
a large class of phenomena show power-law distributions with asymptotic 
long tails. Typically, these phenomena arise in presence of long-range forces, 
long-range memory, in chaotic systems, in opens systems or when dynamics 
evolves in a non-euclidean multi-fractal space-time. In the last decade many 
authors pursued new statistical mechanics theories that mimic the structure 
of the Boltzmann-Gibbs theory, while capturing the emerging experimental 
anomalous behaviors (Kaniadakis and Lissia 2003). In the last ten years, 
an intense activity has been modifying and improving our understanding of 
contemporary Statistical Mechanics and Thermodynamics. 

The result is proposed as the Second Law of Thermodynamics for the 
open systems, but, better, as the Fourth Law of Thermodynamics. 
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